Wherefore, what is claimed is: 

1 . A computer-implemented process for generating a three 
dimensional model of an object from a single image, comprising the process 
actions of: 

obtaining an image of an object; 

identifying at least one object to be modeled in the image; 
determining features of the object in the image; and 
aligning the features of a generic model of the identified object with the 
features of the object in the image to obtain a tailored model. 

2. The computer-implemented process of Claim 1 further comprising 
the process action of: 

applying texture of the object in the image to the tailored generic model. 

3. The computer-implemented process of Claim 1 , further comprising 
the process actions of: 

determining if the object in the image is rotated out of the plane of the 
image prior to using the features of the object in the image to align the features 
of a generic model of the object with the features of the object in the image to 
obtain a tailored model; 

determining the amount of out of plane rotation of the object in the image; 

and 
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using the amount of rotation of the object in the image to rotate the 
generic model to match the input image. 

4. The computer-implemented process of Claim 1 wherein the 
process action of determining the features of the object comprises determining 
the features by at least one of the following: 

using a pattern recognition technique to locate the features; 
an edge detection technique to locate the features; and 
using a generic model of the object to locate the features. 

5. The computer-implemented process of Claim 1 wherein the generic 
model of the object is represented as a linear combination of a neutral object, 
and some number of object metrics, wherein an object metric is a vector that 
linearly deforms the object in a certain way. 

6. The computer-implemented process of Claim 4 wherein the linear 
combination of a neutral object is represented by a mesh of vertices and 
triangles that represent the shape of the object. 

7. The computer-implemented process of Claim 4 wherein the 
process action of aligning the feature of a generic model of the object to the 
features of the object in the image to obtain a tailored model comprises 
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modifying the object metrics so that the generic model matches the shape of the 
object in the image. 

8. The computer-implemented process of Claim 1 wherein the object 
modeled is a face. 

9. The computer-implemented process of Claim 1 wherein the object 
modeled is a human body. 

10. The computer-implemented process of Claim 1 wherein the object 
modeled is an animal. 

1 1 . The computer-implemented process of Claim 1 wherein multiple 
objects are modeled by repeating the following process actions for more than 
one object: 

identifying at least one object to be modeled in the image; 
determining features of the object in the image; and 
aligning the features of a generic model of the identified object with the 
features of the object in the image to obtain a tailored model. 

12. A system for creating a face model from the input of a single image 
of a face, the system comprising: 
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a general purpose computing device; and 

a computer program comprising program modules executable by the 
computing device, wherein the computing device is directed by the program 
modules of the computer program to, 

input a single image of a face; 

use a face detector to find the face to be modeled in the image; 
determine features of the face to be modeled; 
align features of a generic face model to features of the face in the 
image to obtain a tailored face model; and 

apply the texture of the face in the image to the tailored generic 

face model. 

13. The system of Claim 12 further comprising modules to: 
determine if the face in the image is rotated out of the plane of the image 

prior to using the features of the face in the image to align the features of a 

generic face model with the features of the face; 

determine the amount of out of plane rotation of the face in the image; 

and 

use the amount of rotation of the face in the image to rotate the generic 
face model to match the face in the input image. 
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14. The system of Claim 12 wherein the features of the face to be 
modeled comprise two eyebrows, two eyes, a nose, a mouth and two sides of a 
face. 

15. The system of Claim 12 wherein the generic model of a face is 
represented as a linear combination of a neutral face, and some number of face 
metrics, wherein a face metric is a vector that can linearly deform the neutral 
face model in a certain way. 

1 6. The system of Claim 1 5 wherein a generic model of a face is 
represented by a vector 5 =(v 1 r v ..,v n r ) r where v, =(X i9 Y i9 Z § ) T (i = I ...,«) are the 
vertices, and a metric is represented by a vector M={hv } 5v„) r , where 8v/ 
=(5X, ,5^ ,5Z,) T .and wherein a neutral face S?=(v° T ,...y n T ) T , and a set of m 
metrics M j =(8v/ T 8vf ) r , and wherein the linear space of face geometries 
spanned by these metrics is 

m 

s = s° + Y* c j m j sub J ect t0 c j G Vj. > u j ] 

7=1 

where the c/s are the metric coefficients, and /, and uj are the valid range of cj. 

17. The system of Claim 15 wherein the linear combination of a neutral 
face is represented by a mesh of vertices and triangles that represent the shape 
of the face. 



23 



1 8. The system of Claim 1 5 wherein using the features of the object to 
be modeled to align the features of a generic face model to the feature points of 
the face in the image comprises modifying the face metrics so that the generic 
face model matches the shape of the face in the image. 

1 9. The system of Claim 1 5 wherein using the features of the face to 
be modeled to align the features of a generic face model to the features of the 
face in the image comprises modifying the face metrics so that the generic face 
model matches the shape of the face in the image. 

20. The system of Claim 19 wherein modifying the metrics comprises: 
calculating the differences between the generic face model and the face 

in the image; and 

adjusting the generic face model to represent the face in the image by 
using said calculated differences to adjust the generic face model. 

21 . The system of Claim 1 7 wherein the module for applying texture 
comprises: 

associating each vertex on the generic face model with its coordinates in 
the image; and 

using said associated coordinates of the vertices with the image to apply 
said texture of the original image. 
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22. A computer-readable medium having computer-executable 
instructions for creating a three-dimensional model of an object in a single 
image, said computer executable instructions comprising: 

inputting a single image of a three-dimensional object; 

creating a generic linear space representation of the three-dimensional 
object depicted in the image; 

estimating object pose and linear coefficients describing the three- 
dimensional object in the image in the linear space using an orthogonal 
projection; 

using the estimated pose and linear coefficients to obtain a linear space 
model of the object in the image; and 

applying texture information of the three-dimensional object in the image 
to the linear space model of the object. 

23. The computer-readable medium of Claim 22 wherein said 
computer-executable instruction for creating a generic linear space 
representation of the three-dimensional object depicted in the image, comprises 
sub-instructions for: 

using an object detector to find the object to be modeled in the image; 
determining features of the object; and 
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using the features of the object to be modeled to align the features of a 
generic linear space representation of the object to the shape of the object in the 
image. 

24. The computer-readable medium of Claim 22 further comprising a 
computer-executable instruction for changing the characteristics of the linear 
space model of the object by changing the shape of the linear space model of 
the object in the image underlying the texture. 
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